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[57] ABSTRACT 

A system and method arc provided to allow a user to control 
the appearance of a control region displayed along with a 
medical image on a medical device. In one preferred 
embodiment, when the user positions a pointer over a 
control region, the appearance of the control region ensures 
readability by a user. When th e user positions the po inter 
away from the co ntrol rcf rinn^ tfie appearance of the con trol 
reg ion cfl ajogcs ^'''^'^ ^iglra cting form. In this way, control 
regions are made easy to read when a user is u sing the 
contro lsand are made less dis feractmg when a user is viewing 
r m edical im ages. 
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METHOD AND SYSTEM FOR CHAiNGING 

THE APPEARANCE OF A CONTROL 
REGION OF A MEDICAL DEVICE SUCH AS 
A DIAGNOSTIC MEDICAL ULTRASOUND 

SYSTEM 5 

BACKGROUND 

Medical devices, such as ultrasound imaging systems and 
medical image review stations, display medical images and 
are often used in dimly-lit rooms in order to improve the jq 
visuali2ation of the displayed images. Many medical devices 
also display high-luminance user-interface controls that are 
used in conjunction with the displayed images. While these 
high-luminance controls are easily readable by a user, they 
often distracts the user's eyes from the displayed medical 
images. 

SUMMARY 

The present invention is defined by the following claims, 
and nothing in this section should be taken as a limitation on ^ 
those claims. 

By way of introduction, the preferred embodiments 
described below allow a user to co ntrol the aim fcaraac£,of a 
control region d isplayed along with a medical imag e_Qp a 
medical device, in one preferred embodiment, when the user ^ 
positions ^l iointer over a control region , the appe arance_o f 
the Contr ol region ensures reada|; til jty l^y a ]j sei\ When the 
user'p'(5sin ons the pointer away from the control reg ionTThe 
ap ^araxiCTo t the control region chan ges to a less distracti ng 
form. I n this ^gy, coutml regions are made easy to ready 
wden a user is using the controls and are made less distract- j 
ing when a user is viewing displayed medical images. \ 

The preferred embodiments will now be described with 
reference to the attached drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 35 

FIG, 1 is an illustration of an ultrasound imagmg system 
and an image review station of a preferred embodiment. 

FIG. 2 is an illustration of a screen display of a preferred 
embodiment in which a pointer is positioned over a control ^ 
region. 

FIG. 3 is a flow chart of a method of a preferred 
embodiment for changing the appearance of a control region 
of a medical device. 

FIG. 4 is an illustration of a screen display of a preferred 45 
embodiment in which a pointer is positioned away from a 
control region and the appearance of each control region is 
changed. 

FIG. 5 is flow chart of a method of a preferred embodi- 
ment for changing the luminance of a control region of a 50 
medical device. 

FIG. 6 is an illustration of a screen display of a preferred 
embodiment in which control regions are hidden from view. 

FIG. 7 is an illustration of a screen display of a preferred 
embodiment in which the appearance of only one control ss 
region is changed. 

FIG. 8 is an iUustration of a screen display of a preferred 
embodiment in which the appearance of only control regions 
1, 3, and 4 are changed. 

FIG. 9 is an illustration of a screen display of a preferred ^ 
embodiment in which only the control region selected by a 
pointer returns to its original appearance. 

DETAILED DESCRIPTION OF THE 
PRESENTLY PREFERRED EMBODIMENTS 

As \iscd herein, the term "digital medical image" includes, 
but is not limited to, an ultrasound image as well as an image 



2 

generated by any of the following modalities: computed 
radiography, magnetic resonance, angioscopy, color flow 
Doppler, cystoscopy, diaphanography, echocardiography, 
fluoresosin angiography, laparoscopy, magnetic resonance 
angiography, positron emission tomography, single-photon 
emission computed tomography, x-ray angiography, com- 
puted tomography, nuclear medicine, biomagnetic imaging, 
culposcopy, duplex Doppler, digital microscopy, endoscopy, 
fundoscopy, laser surface scan, magnetic resonance 
spectroscopy, radiographic imaging, thermography, and 
radio fluroscopy. 

Also as used herein, the term "medical device" refers to 
any device that can display digital medical images. Medical 
devices include, but are not limited to, medical image 
acquisition devices, such as an ultrasound imaging system, 
and medical image review stations. 

Turning now to the drawings, FIG. 1 is an illustration of 
two medical devices that can be used with the presently 
preferred embodiments: an ultrasound imaging system 100 
and a medical image review station 200. Generally, a medi- 
cal device includes a display device 110, 210 and a pointing 
device to manipulate a point er (such as anarrow)_displayed 
on the'tlSpIajf_deyi££jULD, 210. The term "pomting device" 
is intendeH^to encompass any suitable device for manipu- 
lating the pointer on the display devi ce 110, 120 and 
includes a keyboard 120, 220, trackba ll 130 , mouse 230, 
touch padTtOuclTscreen, and light pen. The pointing device 
can be-physicaliyincorporated into the medical device, such 
as the trackball 130 in the ultrasound imaging system 100, 
or can be a separate component, such as the mouse 230 in 
the medical image review station 200. 

The medical device is operative to display a medical 
image and a control region on the display device 110, 210. 
As used herein, the term "control region" refers to an area 
of the display device 110 that is associated with a function 
that can be ^rformed in con junction with a niedicallmage. 
Functions that can be associated "with controTTegions 
include, but are not limited to, presenting next/previous 
medical images, loading patient data associated with a 
medical iffiage, printing a medical image, changing the 
display format of a medical image, indicating whether a 
medical image has been reviewed, deleting a medical image, 
archiving a medical image, editing a medical image, and 
accessing other display screens. The use r can select a contro l 
region, for example, by g ositioning a pointer over the 
cont rol re gio n and indicatin p ^ R^lpritin T^ f^r clicking a 
mouse bjiUon) or by me rely prKitinnipp the pointer o ver the 
control r egion. Imag es (such as a symbol or icon) and/or text 
can be displayed in the control region to allow the user to 
identify which function wiU be performed upon selection of 
the control region. 

FIG. 2 is an illustration of a screen generated on the 
display device by an application ruiming in the medical 
device. As shown in FIG. 2, this screen displays two medical 
images 10, 20, a pointer 30, and a toolbar 40 containing 
control regions 1-5. As discussed in the Background section 
above, the appearance of the control regions can be distract- 
ing to a user when he is studying the displayed images 10, 
20. To remove this distraction, the medical device is 
equipped with an appearance-control application thai 
changes the appearance of the control regions in response to 
the position of the pointer 30. It is preferred that the 
appearance-control appUcation be implemented with soft- 
ware and that the medical device comprise the necessary 
hardware (such as a CPU) to execute the software. Of 
course, any appropriate software language, preferably C-M-, 
and any appropriate hardware, analog or digital, can be used. 
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Additionally, all of Ihe functionality can be implemented application takes no action and waits for the next pointer 

exclusively with hardware. movement Table 1 lists pseudo-code that embodies one 

The flow chart of FIG. 3 illustrates the operation of the form of the method described above, 

appearance-control application. As shown in this flow chart. The appearance-control application can change the 

the appearance-control application first compares the posi- 5 appearance of the control regions in other ways. For 

tion of the pointer, which can be provided by the medical example, instead o f merely changing the brightness oF the 

device's operating system, with the location of the control control le^loub, Uic appearance -controi applicatiQ n'''can 

regions to determine whether the pointer is positioned away chanpethr'TOloTof ^ control jegions-tOL-m ake them less 

from the control regions (310). If the pointer is positioned distracting to-anlS^^.g., changing the color of a control 

away from the control regions, the appearance -control appli- jq regtOn'^from an alarming red to a soothing gray). The 

cation changes the appearance of the control regions (320). appearance -control applic ation can also change the_^iy or 

The following examples wiU illiistrate the operation of this shape of the control regicShs (e.g., reducing the size of th e 

method. conTroT re gions to make them less of a distractio n). 

When a tiser is using (e.g., viewing or selecting) a control AdditionaHy, the appearance-control appiicatton can invert 

region, he positions the pointer 30 over one of the control ^5 the appearance of two areas of a control region. For 

regions, and the appearance of the control regions preferably example, the appearance-control application can invert the 

allows the user to clearly and easily discern the control color of the background with the color of the text of a control 

regions on the display screen, as shown in FIG. 2. When a region (e.g., black text on a white background to white text 
user is studying a displayed medical image 10, 20, howeyej;,, on a black background). Further, the appearance-control 

the ap^f:araac©-of4he-csiQtroLr£gions can make the medical 20 apptication can change the appearance of the control regions 

image 10, 20 digsailLto.yieiy-JIa change the appearance of by hiding the control regions from the user, as shown in FIG. 

the control regions to a less distracting f orm, the user moves 6. Although the control regions are not visible to the user, the 

the pointer 3 0 awa\ L-from the control regions, as shown m appearance-control application will recognize when the 

FIG. 4. When the appearance-control application detemunes pointer 30 is positioned in the area of the screen that 

that the pointer 30 is positioned away from the control 25 formerly displayed the control regions. When the poi nter 3 0 

regions, it changes the appearance of the control regions to returns to this area, the i^rr^rnnrr frnntrnl jgjplication a gain 

make the conUol regions less distracting to the user. When displays the control regions to the user. Because novi re user s 

the us er wants to use the control regi ons again, he simply may not Know how to ac' C g ss liiL lJe nncontrolligions, it may 

returns the point er 30 over one ot the controi regions, and the be prefefrTd to use*an bther tecMa nnhaTallows tEc^i^ontrol 

app earan ce -control application returns th e control f tiglonsio 30 regions Jo Jbe visible without beings, distraction. 

their ongi aI.aEp£flrancc.(ijc..,ihe appeara nce shown m H Q. There are several alternatives to the "embodiments 

^ 2). described above. In the preferred embodiment discussed 

As described above, when the user moves the pointer 30 above in conjunction with FIG. 4, the appearance-control 

away from the control regions, the appearance-control appH- application changed the appearance of every control region 

cation changes the appearance of the control regions. There 35 in response to the pointer 30 being either over or away from 

are several techniques that can be used to accomplish this. any one of the control regions. In another preferred 

Preferably, the appearance-control appUcation changes the embodiment, the appearance-control application changes 

appearance of the control regions by changing the luminance the appearance of only t he control re gio n over which th e 

of the control regions. The medical device can use the H-S-B pointer was previou sly located , hor example, in FIG. 2, the 

(Hue-Saturation- Brightness) color model to represent a 40 pdlTner'30"is positioned over control region 3. When the user 

color pixel on the display device. In the H-S-B color model, moves the pointer 30 away from control region 3, the 

a pixel's luminance is represented by its B (Brightness) appearance-control application changes the appearance of 

value, which ranges from 0 to 100. Preferably, the control regionJi-iKithout changing the appearancenafthe 

appearance-control application reduces the luminance value other c ontrol regi ons, as shovyn liTFIG' 7. "WHen"the user 

of the contiol regions by 50% when the user positions the 45 returns the pointer 30 over control region 3 (or. alternatively, 

pointer 30 away from the control regions (e.g., a B value of over any of the control regions), control region 3 returns to 

80 is reduced to 40). In this way, when the user positions the its original appearance shown in FIG. 2. In another preferred 

pointer 30 over the control regions, t he control region s embodiment, the appearance-control application changes 

appe ar in a^" i jnrm ar' state, a nd_when the user moves th e the appearance of some, but not all, of the control regions 

pointe r30"awav from the cnnfml rpginns the cnn trol regio ns 50 when the pointer 30 is moved. For example, when the user 

appe ar in a "dimmed" state. moves the pointer 30 away from control region 3 in FIG. 2, 

FIG. 5 is a flow chart of a preferred method for reducing the appearance-control application can change the appear- 

the luminance of a control region. First, the pointer's loca- ance of control regions 1, 3, and 4 but not control regions 2 

tion is obtained (510), and then the appearance-control and 5, as shown in FIG, 8. When the user rctunos the pointer 

application determines if the pointer is over a control region 55 30 over control region 1, 3, or 4 (or, alternatively, over any 

(520). If the pointer is over a control region, the control- of the control regions), control regions 1, 3, and 4 return to 

appearance application then determines if the control their original appearance shown in FIG. 2. Alternatively, 

regions are dimmed (530). If the control regions are only some of the control regions return to Uieir original 

undimmed, no action is taken, and the control-appearance appearance. In FIG. 9, for example, only the control region 

application waits for the next pointer movement If the 60 over which the user returns the pointer 30 is returned to its 

control regions are dimmed, the control-appearance appli- original appearance. In yet another alternative, when the 

cation returns the control regions to their undimmed state pointer rettirns to a control region, the appearance-control 

(540). Similarly, if the pointer is not over a control region, application returns another control region, but not the con- 

the control-appearance application determines if the control trol region over which the pointer is currently located, to its 

regions arc undimmed (550). If the control regions are 65 original appearance. 

undimmed, the control -appearance application dims the It is important to note that one or more of the preferred 

control regions (560); otherwise, the oontiol-appearance embodiments described above can be used in combination. 
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For example, when a user moves the pointer away from the 
control regions, the appearance -control application can dim 
control regions 1 and 2, change the size of control regions 
3 and 4, and hide control region 5 from view. Additionally, 
the degree of appearance changes can vary. For instance, in 
the preceding example, the appearance-control application 
can dim control region 1 more than control region 2. In 
another alternative, instead of returning the control regions 
to their original appearance, the appearance-control appli- 
cation can change some or all of the control regions to a 
different appearance. For example, some or all of the control 
regions can become brighter than their original state after 
returning from their dimmed state. 
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In another alternative embodiment, the appearance of the 
control regions change to become more — not less — 
noticeable to the user. F or example, instead of reducing the 
size of the control rc^ons when the pomter is positioned 
^ aw ay fromJh 6.£flDtiQlje^iaiiS, the appearance-control appli- 
caGon can incrcascjli£_size nf the mntrp] |eulMiik 

It is intended that the foregoing detailed description be 
10 understood as an illustration of selected forms that the 
invention can take and not as a definition of the invention. 
It is only the following claims, including all equivalents, that 
are intended to define the scope of this invention. 



TABLE 1 



E*rogramStart 

/* Beginniag of program */ 
{ 

/• Initialize global variables "/ 
Execute Initialize 'Wriablca 

/• Continue to monitor mouse movement until the program ends */ 

Run until the program ends 

{ 

Execute WaitForCursorMove 

} 

} 

Initialize Variables 

/" Routine to initialize global variables */ 

ControlFfldeMaximum - 1.0;/* Pull luminous value (normal brightness) */ 
Control FadeMinimum « 0.5;/* 50% luminous value (dimmed brightness) "*/ 
Control RedraWlime =10; /" Hme interval (in milliseconds) for redrawing 
control ■/ 

MaxFadeUme = 100; /* Max time (in milliseconds) to fade control •/ 
ExpiredFadeTLme - 0; /' Amount of time (in milliseconds) expired during 
fade process */ 

Control Fade Value = 1.0; /' Current fiade value (open between 1.0 and 0.5) 
for control */ 

TlmerlD = 0; /* ID assigned to routine that get called 
periodically V 
} 

WaitForCursorMove 

/* Gets called when the cursor is moved, initiates dimming and brightening •/ 
{ 

/• Check to see if the cursor was moved over a control */ 
If the cursor just moved over a control 

{ 

/* If we are currently dimming a control, stop the operation '/ 
/* The operating system provides this capabDity */ 
TferminateTimerRoutineCrimerlD) 
/• Brighten the control */ 
Execute F^deUp 

} 

/* Check to see if the cursor was moved away from a control •/ 

If the cursor just moved away from a control 

{ 

/• If we are cunently dimming a control, stop the operation •/ 
/• The operating system provides this capability •/ 
TcrminatcTImcrRoutineCrimerl D) 
/■ Dim the control •/ 
Execute InitiateFadeDown 

} 

(nitiatcFadeDown 

/" Initiates the control dimming operation •/ 
{ 

/" Initialize ExpiredFadeTlme to MaxFadeTimc */ 
ExpiredFadeTune - MaxFadeTlme; 
/* Dim the control •/ 
Execute FadcDown 

} 

FadeDown 

/* Performs dim operation on a control */ 
{ 

/• Update expired fade time •/ 

ExpiredFadeTlme - ExpiredFadeUme - ControlRedrawTime; 
/• If it is less than 0, set it to 0 •/ 
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TABLE 1 -continued 



if ExpircdFadcTUnc is less than 0 

ExpircdFadeltme = 0; 
/• Calculate the control fode value */ 
Execute CalculaleContiolFadcValuc 

/• RedjBw the control to reflect the new brightness value •/ 
Execute RedrawControl 

/• If appropriate, set a timer to execute FadeDown again •/ 
/• The operating system provides this capability */ 
if ExpiredF^dcTUnc is greater than 0 

TunerED - lnstairnmeiRoutine(FadeDown, ControlRedrawtime) 

} 

tnitiatePade Up 

/• Initiates the control brightening operation '/ 
{ 

/' Initialize ExpuedFadeTime to 0 '/ 
ExpircdFadcTimc - 0; 
/• Brighten the control •/ 
Execute FadeUp 

} 

FadeUp 

/• Performs brighten operation on a control */ 
{ 

/• Update expired fade time */ 

ExpiredFadeTimc » ExpircdFadcTimc + Control RedrawUme; 
/* If it is greater than MaxFadeTune, set to MaiFadeTime */ 
if ExpiredFadeXlme is greater than MaxFadcUme 

ExpiredFadeHmc = MaxFadeTlmc; 
/• Calculate the control fade value •/ 
Execute CalculateControlFadeVWuc 

/• Redraw the control to reflect the new brightness value */ 
Execute RedrawControl 

/* If appropriate, set a timer to execute FadeUp again */ 
/• The operating system provides this capability •/ 
if ExpiredFadeUme is less than MaxFadelune 

HmerlD = InstairnmerRoutine(FadeUp, ControlRedrawTime) 

} 

Cal culatcCo ntro IFadcMilue 

/* Calculates new CtontrolFade Value based upon the value of ExpiredFadeTime •/ 
{ 

ControlFadeV^lue = ControlFadeMinimum + ((ControlFadeMaximum - 
Control FadeMinimmn) • (ExpiredFadeTime/ 
MaxFadcUme)) 

} 

RedrawControl 

/* Redraws a control to reflect a new brightness setting */ 
{ 

/• Calculate new brightness value based upon ControIFade\^lu6 */ 
NewBrightncss Value = Original Brightness Value • ControlFadeVWuc 
/• Convert HSB color value to RGB color value "/ 
/• The operating system provides this capability •/ 
HSBToRGB(OriginaIHue\^lue, OriginalSaturation Value, 
NewBrightnessVfelue, RedMilue, Green Value, Blue Value); 
/• Use the RGB color value to draw the control */ 

} 



What is claimed is; 

1. In a medical device comprising a display device, an 50 
application operative to display a medical image and a 
plurality of control regions on the display device, and a 
pointer device operative to position a pointer on and away 
from one of said plurality of control regions; a method for 
changing the appearance of at least two of said plurality of 
control regions, the method comprising: 

(a) determining whether the pointer is positioned away 
from said plurality of control regions; and then 

(b) changing the appearance of at least two of said 
plurality of control regions in response to the pointer 
being positioned away from said plurality of control ^ 
regions. 

2. The method of claim 1, wherein (b) comprises changing 
the luminance of at least two of said plurality of control 
regions in response to the pointer being positioned away 
from said plurality of control regions. 65 

3. The method of claim 1, wherein (b) comprises reducing 
the luminance of at least two of said plurality of control 



regions in response to the pointer being positioned away 
from said plurality of control regions, thereby making the at 
least two of said plurality of control regions less distracting 
to a user viewing said medical image on said display device. 

4. The method of claim 1, wherein (b) comprises changing 
the color of at least two of said plurality of control regions 
in response to the pointer being positioned away from said 
plurality of control regions. 

5. The method of claim 1, wherein (b) comprises changing 
the color of at least two of said plurality of control regions 
to make the at least two of said plurality of control regions 
less distracting to a user viewing said medical image on said 
display device, in response to the pointer being positioned 
away from said plurality of control regions. 

6. The method of claim 1, wherein a control region 
comprises a first area characterized by a first appearance and 
a second area characterized by a second appearance, and 
wherein (b) comprises inverting the first and second appear- 
ances in response to the pointer being positioned away from 
said plurality of control regions. 
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7. The method of claim 1, wherein a control region 
comprises a first area characterized by a first cobr and a 
second area characterized by a second color, and wherein (b) 
comprises inverting the first and second colors in response 

to the pointer being positioned away from said plurality of 5 
control regions. 

8. The method of claim 1, wherein a control region 
comprises a first area characterized by a first appearance and 
a second area characterized by a second appearance, and 
wherein (b) comprises inverting the first and second appear- lO 
ances to make the at least two of said plurality of control 
regions less distracting to a user viewing said medical image 
on said display device, in response to the pointer being 
positioned away from said plurality of control regions. 

9. The method of claim 1, wherein (b) comprises changing 15 
the size of at least two of said plurality of control regions in 
response to the pointer being positioned away from said 
plurality of control regions. 

10. The method of claim 1, wherein (b) comprises reduc- 
ing the size of at least two of said plurality of control regions 20 
in response to the pointer being positioned away from said 
plurality of control regions, thereby making the at least two 

of said plurality of control regions less distracting to a user 
viewing said medical image on said display device. 

11. The method of claim 1, wherein (b) comprises remov- 25 
ing at least two of said plurality of control regions from the 
display device in response to the pointer being positioned 
away from said plurality of control regions. 

12. The method of claim 1, wherein (b) comprises chang- 
ing the appearance of at least two of said plurality of control 30 
regions from a first appearance to a second appearance in 
response to the pointer being positioned away from said 
plurality of control regions, and wherein the method further 
comprises: 
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(c) determining whether the pointer is positioned over one 
of said plurality of control regions; and then 

(d) changing the appearance of the at least two of said 
plurality of control regions from the second appearance 
to the first appearance in response to the pointer being 
positioned over one of said plurality of control regions. 

13. In a medical device comprising a display device, an 
application operative to display a medical image and a 
plurality of control regions on the display device, and a 
pointer device operative to position a pointer on and away 
from one of said plurality of control regions, the improve- 
ment comprising: 

first means for determining whether the pointer is posi- 
tioned away from said plurality of control regions; and 

second means for changing the appearance of at least two 
of said plurality of control regions in response to the 
pointer being positioned away from said plurality of 
control regions. 

14. A computer usable medium having computer readable 
program code embodied therein for use in a medical device 
comprising a display device, an application operative to 
display a medical image and a plurahty of control regions on 
the display device, and a pointer device operative to position 
a pointer on and away from one of said plurality of control 
regions; the computer readable program code comprising: 

first computer readable program code operative to deter- 
mine whether the pointer is positioned away from said 
plurality of control regions; and 

second computer readable program code operative to 
change the appearance of at least two of said plurality 
of control regions in response to the pointer being 
positioned away from said plurality of control regions. 

***** 
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--distract-- in its place. 

In column 2, line 25, delete "120" and substitute 
--210-- in its place. 

In column 4, line 45, delete "(or." and substitute 
--(or,-- in its place. 

In column 7, line 12, delete "ControlRedrawtime" and 
substitute - -ControlRedrawTime- - in its place. 

In column 7, line 14, delete "InitiateFade Up" and 
substitute --InitiateFadeUp-- in its place. 

Signed and Sealed this 
Twenty-fourth Day of April, 2001 



Attest: 



MCHOLAS P. CODICI 

AneStinfl Officer Aeiiag Dlrtrtm oflht United Stales Patent end Tradtmark OffiCf 
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